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METHOD AND SYSTEM FOR QUICKLY DEVELOPING 
APPLICATION SOFTWARE FOR USE IN A 
MACHINE VISION SYSTEM 



Technical Fiel^ 

This invention relates to methods and systems 
for developing application software for use in a machine 
vision system. 

Backg round Art 

Application software is the cornerstone of 
every successful vision system job and normally accounts 
for the majority of the development effort. 

At one extreme there are general purpose 
vision systems for generic gauging, verification, or 
flaw detection applications. These systems come with a 
standard interface configurable with a keyboard and 
mouse . 

Successful applications most often require 
software changes to cope with individual site require- 
ments. Most general purpose systems are closed, or 
difficult to modify. Others can only be reconfigured 
through various programming languages. 



There is a need to configure and customize the 
application in the shortest time, yet provide powerful 
algorithms. Some systems can be modified using "C" . 
25 Some require one to learn the supplier's proprietary 
language. Hiring »C» experts, or taking the time to 
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learn yet another language, is expensive and time 
consuming . 

Many times generic vision systems are not the 
answer, so one must build a custom system using a frame 
grabber or fast vision hardware. Software is typically 
the most difficult and time-consuming task of any 
programmable vision system. At best, the board comes 
wxth a library of - C " calls or more often a way to 
program the board at the register level. Not only does 
one have to program the application and design a Windows 
interface, one must understand the performance charac- 
teristics of the board and its behavior so one can write 
algorithms that maximize speed. This is a complicated 
task for someone trying to solve a problem in the 
15 shortest period of time. 

Typically, this process takes man-years - not 
man-months. The only vision system developer that can 
afford this option is one that amortizes engineering 
over hundreds of systems. With today's frequency of 
product improvements, even OEMs are having a hard time 
justifying this approach. 
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The Intelec Corporation of Williston, Vermont 
sells a Windows-based software development package that 
allows users to create machine vision applications and 
handle a range of machine vision functions. The soft- 
ware provides a dynamic link library interface which 
allows the end user to add special purpose algorithms 
for image processing and analysis. 

Xiris, Inc. of Burlington, Ontario, Canada 
30 makes a software package including image processing 
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algorithms. The package is configured as a Visual Bas 
Extension (VBX) to allow the building of autom at 
inspection applications. 

Summary Of T he Invention 

An object of the present invention is to 
provide a method and system for quickly developing 
application software for use in a machine vision system. 

Another object of the present invention is to 
provide a method and system for simply and flexibly 
developing application software for use in a machine 
vision system with a graphical user interface such as 
Windows interface. 

Yet another object of the present invention is 
to provide a method and system for developing applica- 
tion software for use in a machine vision system without 
the need to develop core vision algorithms and/or 
complex calibration techniques. 

Still another object of the present invention 
is to provide a cost-effective method and system for 
developing application software for use in a machine 
vision system using standard PC hardware and a frame 
grabber or vision processor while providing a graphical 
user interface, such as a Windows interface. 

In carrying out the above objects and other 
objects of the present invention, a method is provided 
for quickly developing application software for use in 
a machine vision system using a computer system. The 
method includes the step of storing an application 
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development program, including a first set of custom 
control programs representing possible components of a 
user interface for the machine vision system. The first 
set of custom control programs define a first set of 
5 custom controls. The method also includes the step of 
storing a second set of custom control programs repre- 
senting possible machine vision algorithms for the 
machine vision system. The second set of custom control 
programs define a second set of custom controls. The 
10 method further includes the step of storing hardware 
operating parameters corresponding to possible hardware 
for use in the machine vision system. The hardware 
operating parameters define a third set of custom 
controls. The method further includes the step of 
displaying a graphical representation of the possible 
components, the possible hardware and the possible 
machine vision algorithms. Then, the method includes 
the step of receiving commands from a user of the 
computer system to select a first custom control program 
corresponding to a desired component of the user inter- 
face, desired hardware operating parameters correspond- 
ing to desired hardware and a second custom control 
program corresponding to a desired machine vision 
algorithm. Finally, the method includes the step of 
25 linking the first custom control program with the 
desired hardware operating parameters to the second 
custom control program to form the application software 
in response to the commands. 



15 



20 



30 



Further in carrying out the above objects and 
other objects of the present invention, a system 
provided for carrying out the method steps. 
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The benefits accruing to the method and system 
of the present invention are numerous. For example, the 
method and system: 

Simplify and accelerate the process of devel- 
oping vision applications by using a Visual 
Programming Environment ; 

Utilize image processing algorithms that are 
robust, accurate, fast, and reliable; 
Reduce software debugging time; 
Develop applications which can easily have a 
graphical user interface such as a Windows™ 
user interface; 

Support various processors and various frame 
grabbers such as Cognex processors; 
Interface to various video sources including 
analog, digital, and the line scan cameras in 
addition to other image sources like a scan- 
ner; 

Provide programmable tools for various appli- 
cation development environments such as Visual 
Basic™, Visual C++™, or Borland® Delphi™; 
Use standard technology such as visual basic 
extension (VBX) technology; 

Include a library of image processing and 
analysis techniques such as color, distortion 
correcting calibration, and template matching; 

• Provide calibration such as non-linear, 2-D, 
and 3-D calibration- 
Include components or custom controls for 
multi-axis motion control; 

• Transparently accelerate speed by using on- 
board vision processing; and 

• Operate typically with a single monitor. 
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The above objects and other objects, features, 
and advantages of the present invention are readily 
apparent from the following detailed description of the 
best mode for carrying out the invention when taken in 
connection with the accompanying drawings. 

Brief Desc ription Of The Drawing s 

FIGURE 1 is a schematic diagram illustrating 
a preferred hardware configuration on which the method 
of the present invention can be implemented; 

FIGURE 2 is a schematic diagram illustrating 
a machine vision system which can be supported by the 
method and system of the present invention; 

FIGURE 3 is a screen display of a Visual Basic 
programming environment ,- 

15 FIGURE 4 is a portion of the Visual Basic 

programming environment after custom controls of the 
present invention have been added ; 

FIGURE 5 is a screen display associated with 
a camera custom control; 
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FIGURE 6 is a screen display associated with 
an SE100 custom control; 

FIGURE 7 is a screen display associated with 
a Magic custom control; 
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FIGURE 8 is a screen display associated with 
a VP50 custom control; 
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FIGURES 7-11 are screen displays associated 
with a editable image custom control; 

FIGURES 12-22 are screen displays . associated 
with a search tool custom control; 

5 FIGURES 23-27 are screen displays associated 

with a blob tool custom control; 

FIGURES 28-29 are screen displays associated 
with a point custom control; 

FIGURES 30-31 are screen displays associated 
10 with a editable shape custom control; 

FIGURE 32 is a screen display associated with 
a stage custom control; and 

FIGURE 33 is a screen display associated with 
a Typel stage custom control. 

15 Best Mode s For Carrying Out The Invention 

Referring now to the drawings figures, there 
is illustrated in Figure 1 a workstation on which the 
method and system of the present invention can be 
implemented. The hardware illustrated in Figure 1 
includes a monitor 10 such as a single SVGA display, a 
keyboard 12, a pointing device such a mouse 14, a 
magnetic storage device 16, and a chassis 18 including 
a CPU and random access memory. In a preferred embodi- 
ment, the chassis 18 is a Pentium-based IBM compatible 
PC or other PC having 8 megabytes of RAM and at least 12 
megabytes of hard disk space. 
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The hardware configuration also includes the 
development environments of either Microsoft Visual 
Basic, Microsoft Visual C++, or Borland Delphi together 
with a Microsoft Windows user interface. 

5 Referring now to Figure 2, there is illustrat- 

ed schematically a machine vision system generally 
indicated at 20 generally of the type which can be 
supported by the method and system of the present 
invention. The machine vision system 20 typically 
10 includes an image digitizer/frame grabber 22. The image 
digitizer/frame grabber 22 samples and digitizes the 
input images from one or more image sources such as 
cameras 24 and places each input image into a frame 
buffer having picture elements. Each of the picture 
elements may consist of an 8 -bit number representing the 
brightness of_ that spot in the image . 



15 



The system 20 also includes a system bus 38 
which receives information from the image digi- 
tizer/frame grabber 22 and passes the information on to 
20 the IBM compatible host computer. 

The system 20 also includes input/output 
circuits 30 to allow the system 20 to communicate with 
external peripheral devices such as robots, programmable 
controllers, etc. having one or more stages. 



25 



One or more of the cameras 24 may be an image 
source such as an analog digital or line scan camera 
such as RS-170, CCIR, NTSC and PAL. 



The system bus 26 may be either a PCI an EISA, 
or VL system bus or any other standard bus. 
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The I/O circuits 30 may support a three axis 
stepper board (i.e. supports multiple axis control) or 
other motion boards. 

The image digitizer/frame grabber 22 may be a 
conventional frame grabber board such as that manufac- 
tured by Matrox, Cognex, Data Translation or other frame 
grabbers . Alternatively, the image digitizer/frame 
grabber 22 may comprise a vision processor board such as 
made by Cognex. 



The machine vision system 20 may be programmed 
at a mass storage unit 32 to include custom controls for 
image processing, image analysis, third party machine 
vision products, calibration, and interactive CAD/geome- 
try as described in greater detail hereinbelow. Exam- 
15 pies of image processing may include linear and non- 
linear enhancement, morphology, color and image arithme- 
tic. Also, image analysis may include search, edge, 
caliper, blob, template, color, 2-D and 3-D measure- 
ments . 



20 Third party products may include digital I/O, 

various camera formats, motion, databases, SPC and 
others . 

Calibration may include non-linear, 2-D, 3-D 
and color calibration. 

25 Also, interactive CAD/geometry custom control 

may be provided for both 2-D and 3-D space. 

Referring now to Figure 3, there is illustrat- 
ed therein a Visual Basic programming environment 
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screen. However, it is to be understood that the 
programming environment that can be utilized by the 
method and system of the present invention include other 
programming environments such as Microsoft Visual C++ or 
Borland Delphi as well as others. 

Referring now to Figure 4, there are illus- 
trated icons of a Visual Basic toolbox which appear 
after various custom controls, which will be described 
in greater detail hereinbelow, are added thereto. 

Each custom control is generally described as 

follows : 



An editable shape custom control allows a user 
to define an image processing region by interactively 
editing a rectangular ellipsoidal or toroidal (donut) 
15 shape. 

An editable image custom control works like 
the visual basic picture box control with enhancements 
that give the user added image viewing and processing 
options. 



20 



A camera custom control allows a user to 
capture and store live images from a video camera. 



A search tool custom control looks for a 
specific feature in an image that matches a model that 
a user trained it to recognize; reports the characteris- 
25 tic of the feature found. 

A Magic custom control allow the camera 
control to capture images when the user has a Magic 
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vision board installed. (This tool is invisible at run 
time.) 

A blob tool custom control finds groups of 
connected pixels or "blobs" in an image; reports on the 
5 characteristics of each blob it found. 

An SE 100 custom control allows the camera 
control to capture images when the user has an SE 100 
vision board installed. (This tool is invisible at run 
t ime . ) 

10 A VP 50 custom control allows the camera 

control to capture images - and optionally speeds up 
images searches - when the user has a VP vision board 
installed. (This tool is invisible at run time.) 



A Type I stage custom control allows the stage 
control to work with a specific manufacturer's stage 
known as "Type I". (This tool is invisible at run 
time . ) 

A Stage custom control allows a user to 
control a multi-axis stage through a graphical user 
20 interface. The developer can include stage control 
properties and methods in higher level code. 

While not shown, a tool board custom control 
allows a user to navigate through windows and menus in 
the application by simply clicking buttons on a tool 
25 bar. 



Also while not shown, a Type II stage custom 
control allows the stage control to work with a specific 
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manufacturer's stage known as "Type II". (This tool is 
also invisible at run time.) 

Finally, while also not shown, a Type III 
stage custom control allows the stage control to work 
with a specific manufacturer's stage known as "Type 
III". (This tool is furthermore invisible at run time.) 

In general, it is possible to very quickly and 
easily build machine vision applications or programs 
using the custom controls illustrated in Figure 4 in the 
Microsoft Visual Basic programming system. In general, 
one creates the user interface or a vision application 
by placing Visual Basic and the custom controls on a 
form. Next, one sets the properties for both the Visual 
Basic standard controls and the custom controls. 
Finally, one writes code to link together the different 
parts of the application to obtain the application 
program . 

What follows now is a detailed description of 
the various custom controls of Figure 4 together with 
20 example code. Also described for each of the custom 
controls are various properties for use in forming the 
application program. 

Camera VBX Control 
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Description 

Referring now to Figure 5, the camera custom 
control allows color or black and white live image views 
from a video camera and allows static images to be 
grabbed from the video camera as indicated at area 50 
for subsequent processing and analysis. The camera may 
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be envisaged as a real-world 35mm camera, generally 
indicated at 52, with a viewfinder 54 to look through in 
order to compose the image, a button 55 to take a 
picture, various knobs and switches which control how 
the image is taken, an image counter 56, and film 57 
inside the camera with a number of image frames which 
can be individually retrieved. 

The asynchronous image capture facility allows 
images to be taken while other work is being performed, 
thus increasing overall throughput. This is not avail- 
able on all types of cameras. 



File Name 

VISION. VBX 

Object Typ e 
15 Camera 

Remarks 

Before live image views can be displayed and 
before images can be grabbed, the Camera control must be 
linked to a camera from a particular vision board. To 
link the Camera control to the camera from a particular 
vision board, set the Camera property of the Camera 
control equal to the Camera property of a vision board 
control, such as the Matrox Magic control as represented 
by an icon 58. 

To display a live image, click on the view- 
finder on the Camera control. To grab an image, click 
on the shutter release button on the Camera control. 

To display a grabbed image, the Editable Image 
control can be used. Set the Rasterlmage property of 
the Editable Image equal to the Image property of the 
Camera control. 
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Another way to display live image views and 
grab images is to use the context sensitive popup menu. 
To display the popup menu, click the right mouse button 
over the Camera control . 

5 Camera Control Example PnHp 

Place a camera control, Picture control and a 
vision board control {e.g. Matrox control) onto a form, 
and then paste the following code into the declarations 
section of the form. 

10 Sub Form_Load() 

Cameral . Camera=Magicl . Camera 
Cameral . hDisplayWnd=Picturel . hWnd 
End Sub 

Camera Property r Pampr a Control 

15 Descrip tion 

Sets or returns the particular type of Camera 
hardware. This property is not available at design 
time. 

Visual Basic 
20 I form. ] Camera. Camera [=camera&] 

Visual C++ 

pCamera - >GeriNumProperty ( " Camera" ) 
pCamera - >SetNumProperty ( "Camera" , camera) 



25 



Remarks 

This property must be set to the Camera 
property of a vision board Control (such as the Matrox 
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Magic Control), or from another source which provides a 
compatible property. 

Data Tvpp 
Long 

5 Camera Property , Magic Control 

Description 

Returns a value which can be used for the 
Camera property of the Camera Control. This value is 
specified by the Cameralndex property. This property is 
10 read-only at run time, not available at design time. 

Visual Basir 

[ form . ] Magi c . Camera 

Visual C++ 

pMagi c->GetNumProperty ( "Camera" ) 

15 Remarks 

Sets the Camera property of the Camera Control 
equal to this property at run time. 

Data Typ e 
Long 



20 



Rasterlmaae Prop erty, Editable Image Control 

Description 

Sets or returns the image data in the editable 
image. This property is not available at design time. 
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Visual Basic 

[form.] Edl tablelmage. Raster Image [=image&] 

Visual C++ 

pEdi tablelmage- >GetNumProperty ( " Rasterlmage " ) ; 

5 pKditableJniage->SetNumProperty ( "Rasterlmage" , 

image) ; 

Remarks 

This property may be set to the Image property 
of a Camera Control, or from another source which 
10 provides a compatible property. 

Data Type 
Long 

Image Property, Camera Control 

Description 

15 Returns the image of the currently selected 

film frame. This property is read-only at run time, not 
available at design time. 

Visual Basic 

[form.] Camera . Image Oimage&] 

20 Visual C++ 

pCamera- >GetNumProperty ( ,! Image " ) 

Remarks 

This property may be used to set the Raster- 
Image property of the Editable Image control, or a 
25 compatible image property of any other control. 
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Data Type 
Long 

SE100 Control 

Description 

5 Referring now to Figure 6, the SE100 Control 

is a run- time invisible control which provide an imple- 
mentation of the Camera property for use by the Camera 
Control represented by camera control icon 52. An 
editable image or picture box is shown at area 62 in 
10 Figure 6. 

File Name 

VISION. VBX 

Object Typ e 
SE100 

15 Remarks 

To use the SE100 Control, set the Camera 
property of the Camera Control equal to the Camera 
property of the SE100 Control at run time. 

SE100 Control Examp le 

20 Place a Camera Control, a Picture Box Control 

and a SE100 Control (i.e. icon 60) onto a Form, and then 
paste the following code into the declarations section 
of the form: 
Sub Form_Load() 

25 Cameral - hDisplayWnd=Picturel . hWnd 

Cameral . Camera=SE1001 . Camera 
End Sub 
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C amera Property. SE100 Conhrnl 

Descriptip n 

Returns a value which can be used for the 
Camera property of the Camera Control . This property is 
read-only at run time, not available at design time. 

Visual Baf^ ir 

[form. ] SE100. Camera 

Visual C++ 

pSEl 00- >GetNumProperty ( "Camera" ) 

10 Remarks 

Gets the Camera property of the Camera Control 
equal to this property at run time. 

Data Type 
Long 

15 Magic Control 

Description 

Referring now to Figure 7, the Matrox Magic 
Control is a run- time invisible control which provide an 
implementation of the Camera property for use by the 
Camera Control represented by the camera control icon 
52. An editable image or picture box is shown at area 
72 in Figure 7 . 



20 



File Name 

VISION. VBX 
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Obiecfc Typp 
Magic 

Remarks 

To use the Magic Control, set the Camera 
property of the Camera Control equal to the Camera 
property of the Magic Control at run time. 

Magic Control Fvampio 

Place a Camera Control, a Picture Box Control 
and a Magic Control (i.e. icon 70) onto a Form, and then 
paste the following code into the declarations section 
of the form: 



Sub Form_Load() 

Cameral . hDisplayWnd=Picturel . hWnd 
Cameral . Camera=Magicl . Camera 
15 End Sub 

VP50 Control 



Description 

Referring now to Figure 8, the VP50 Control is 
a run-time invisible control which provide an implemen- 
tation of the Camera property for use by the Camera 
Control, and the Model property for use by the Search 
Tool Control represented by the camera control icon 52 . 
An editable image or picture box is shown at area 82 in 
Figure 8 . 
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25 File Name 

VISION. VBX 
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Obiect Typ e 
VP50 

Remarks 

To use the VP50 Control, set the Camera 
5 property of the Camera Control equal to the Camera 
property of the VP50 Control at run time, and set the 
Model property of the search Tool Control equal to the 
Model property of the VP50 Control at run time. 

VP50 CONTROL EXAMPLE 

10 Place a Camera Control, a Picture Box Control, 

a Search Tool Control, an Editablelmage Control and a 
VP50 Control (i.e. icon 80) onto a Form, and then past 
the following code into the declarations section of the 
form . 

15 Sub Form__Load() 

Cameral . hDisplayWnd=Picturel . hWnd 
Cameral . Camera=VP501 .Camera 
SearchTooll .Model=VP501 .Model 

SearchTooll . hTrainingImage=EditableImagel . hCtl 
20 SearchTooll . hSearchingImage= 

Editablelmagel . hCtl 
End Sub 

Sub Cameral_Grab ( ) 

Editablelmagel . RasterImage=Cameral . Image 
25 End Sub 
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Camera P roperty, VP 50 Control 
Descrip tion 

Returns a value which can be used for the 
Camera property of the Camera Control. This property is 
read-only at run time, not available at design time. 

Visual Basir 

(form. ) VPS 0 .Camera 

Visual C++ 

pVP5 O^Ge tNumProperty ( n Camera " ) 

10 Remarks 

Set the Camera property of the Camera Control 
equal to this property at run time. 

Data Type 
Long 

15 Model P roperty, Search Tool Control 

Descrip tion 

Sets or returns the model data in the search 
tool. This property is not available at design time. 

Visual Basic 
20 [form. ] SearchTool . Model [=model&] 

Visual C++ 

pSearchTool-^GetNumProperty ( "Model " ) 
pSearch Tool-»SetNum Property ( "Model " , model) 
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Remarks 

By default, the model data is stored in the 
host memory, and the Search Tool methods run on the host 
CPU. For extra speed, this property may be set to the 
5 Model property of a vision board Control (such as the 
Matrox Control) , or from another source which provides 
a compatible property. 

Data Type 
Long 

10 Model Property, VP 50 Control 

Description 

Returns a value which can be used for the 
Model property of the Search Tool Control. This proper- 
ty is read-only at run time, not available at design 
15 time. 

Visual Basic 

[form. ] VP50 .Model 

Visual C++ 

pVP50-*<3etNumProperty { "Model " ) 

20 Remarks 

Set the Model property of the Search Tool 
Control equal to this property at run time. 
Data Type 
Long 
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15 



Ed i t-ahif. Tma ge Control 

Descrip tion 

Referring now to Figures 9-11, the Editable 
Image control emulates the standard Visual Basic Picture 
control. m addition, at run time one can zoom and 
scroll around the image via scroll bars 90, view the 
coordinates at area 92 and the value of the pixel 
underneath the mouse cursor, perform image processing 
operations on the image, and attach a Region Of Interest 
at 98 to the image. A stretched or distorted image 
appears at area 99. The image may originate from the 
usual Picture or Image properties, or from the addition- 
al Rasterlmage property, which can be set to the Raster- 
Image property from a Camera control or another source. 
The Rasterlmage property can be passed to Machine Vision 
controls . 

File Name 

VISION.VBX 



Object Typ p 
20 Editablelmage 

Remarks 

To scroll around an image, use the scrollbars 
90 provided. The scrollbars 90 appear automatically if 
they are necessary. To zoom into an image, click the 

25 left mouse button over the image. To zoom out as 
illustrated at scaled images 94 and 96, click the middle 
mouse button. Zooming can also be performed using the 
context sensitive popup menu 100 in Figure 10. Click 
over the image with the right mouse button to display 

30 the menu 100. 



WO 97/17639 



PCT/US96/16999 



-24- 



10 



15 11 



20 



The coordinates and value of the pixel cur- 
rently underneath the mouse cursor are displayed at the 
top area 92 of the image. These are only visible if the 
CoordinatesVisible property is set to true. The cursor 
keys can be used to move the mouse in single pixel 
increments . 

Image processing operations may be accessed at 
run time from the popup menu 100. To restrict the image 
processing to a region of interest 98, place an Edit- 
ableShape control on the image control and set the 
hRegionOflnterestShape property to the hCtl property of 
the editable shape. The selected region is indicated at 
102 in Figure 10. The result of performing dilation on 
a selected image region is indicated at 13 0 in Figure 



To link the Editable Image control to an image 
grabbed with a Camera control, set the Rasterlmage 
property of the Editable Image control equal to the 
Image property of the Camera control. 

Editable Tmag g Control Examp le 



Place an Editablelmage control onto a form, 
load an image using the Picture property, place an 
EditableShape on the editable image, and then paste the 
following code into the declarations section of the 
25 form: - 

Sub Form_Load ( ) 

Edi table Imagel .hRegionOflnterestShape 
EditableShapel .hCtl 

End Sub 
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CoordinatesVisible Property, Edi table TTn» qe Control 

Description 

Sets or returns whether the cursor coordinates 
are visible. 

5 Visual Basic 

[form. ] Editablelmage.CoordinatesVisible [ 
{True | False}] 

Visual C++ 

pEditablelmage^GetNumProperty ( » Coordinates - 
10 Visible") 

pEditableImage-»SetNumProperty { "Coordinates - 
Visible" , {True | False} ) 

Remarks 

The cursor coordinates are displayed in 
15 physical world units, as defined by the Calibration 
control referenced in the hCalibration property. 

Date Type 

Integer (Boolean) 

hReaionOf I nter estShape Property. Editable 
2 0 Image Control 

Description 

Sets or returns the region of interest of the 
editable image. This property is not available at 
design time. 

25 Visual Basic 

[form. ] Editablelmage . hRegionOf InterestShape 
[=shape&] 
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Visual C++ 

pEditableImage-*GetNumProperty ( "hRegionOf - 
InterestShape") 

pEditablelmage-^SetNumProperty { "hRegionOf - 
5 InterestShape" , shape) 

Remarks 

This property may be set to the hCtl property 
of an Editable Shape Control. Once set, all operations 
on the image will be restricted to the area enclosed by 
10 the shape. One can clear the region of interest by 
setting this property to Null. 

Date Type 
Long 

hCtl Property. Po int, Editable Shape, Editable Image, 
15 Tool Controls 

Description 

Returns the control handle. 

Visual Basic 

[form,] Control. hCtl 

20 Visual C++ 

pControl-*GetNumProperty ( "hCtl" ) 

Remarks 

This property is used to link one control to 
another. For example, setting the hRegionOf Interest - 
25 Shape property of an Editable Image control to the hCtl 
property of an Editable Shape control defines the region 
of interest for the editable image to be a particular 
shape . 
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Data Type 
Long 

Search Tool Control 

Description 

5 Referring now to Figures 12-22, the Search 

Tool control is a vision tool which can be trained to 
locate a specific feature, or model (i.e. 122), within 
an editable image 121. The trained image appears at 
area 120. If the model 122 is located within the image 
10 a result is produced, which details the location, 
quality, angle, contrast etc. of the located model. A 
search region is defined by area 124. 

Various properties and methods allow the 
training and search process to be controlled. These 
properties and methods can be accessed at design time 
and also at run time through a context sensitive popup 
menu 130 of Figure 13. This menu 130 can be accessed by 
clicking with the right mouse button on the Search Tool 
control. Figure 14 illustrates the interactive edit of 
the shape/location of the image region to be trained 
(i.e. the model) at area 140. Figure 15 illustrates the 
popup menu 150 which lets the user train the select 
image as a model. Figure 17 illustrates at area 170 the 
interactive edit of the shape/location of the search 
25 region. 

File Name 

VISION. VBX 

Object Typ e 

Search Tool 



15 



20 
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Remarks 

The Search Tool has both a graphical user 
interface and a code interface. To use the Search Tool, 
do the following: 

1) The control must first be linked to a 
Model, Images, Editable Shapes and a 
Point by setting the hTraininglmage , 
hSearchinglraage and hResult Point proper- 
ties. The training and searching images 
should have their hRegionOf InterestShape 
property set. 

2) Start the training process by either 
selecting Train from the popup menu or by 
making the training image region of 

15 interest shape visible. Position the 

editable shape over the desired model in 
the training image. 

3) Train the model, by either selecting 
Train for a second time from the popup 

20 menu (i-e. Figure 13) or by calling the 

Train. The trained image or model ap- 
pears in a search tool box 160 in Figure 
16 . 

4) With the searching image region of inter- 
25 es t shape visible, position the editable 

shape to define the searching region. 

5) As illustrated in Figure 18, search for 
the model by either selecting Try from 
the popup menu 180, or by calling the 

30 Search method. 

6) As illustrated in Figure 19, area 190 
indicates when and where the image model 
was found in the search region. The 



WO 97/17639 PCT/US96/16999 



10 



-29- 



results of the search may now be accessed 
through the relevant properties. 
Figure 20 illustrates a screen which is called 
from the search tool popup menu and is used to set 
training parameters. Figure 21 illustrates a screen 
which is also called from the search tool popup menu and 
is used to set search parameters. Finally, Figure 22 
illustrates a screen also called from the search popup 
menu and is used to view the search results. 

Search Tool Byampl 



Place two Editablelmage controls onto a Form. 
Place one Editable Shape control on each Editablelmage 
control and set the Visible property of these Editable 
Shapes to False. Place a Search Tool onto the form, 
15 then paste the following code into the declarations 
section of the form: 
Sub Form_Load() 

SearchTooll . hTrainingImage=EditableImagel 
SearchTooll . hSearchingImage=EditableImage2 

20 Editablelmagel.hRegionOf InterestShape 

=Edi t abl e Shape 1 

Edi t able Image2 .hRegionOf InterestShape 
= Ed i t abl e S hap e 2 
End Sub 

25 Error Messages , Search Tool Control 

The following table lists the trappable errors 
for the Search Tool control. 
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Error number Message explanation 

32 001 HTRAINING I MAGE_NOT__DE F I NED 

A training image must be defined. 
This error is caused by attempting to train a 
feature model when the hTraininglmage property 
is not set . 

32002 HS EARCH I NG I MAGE__NOT__DEF I NED 

A searching image must be defined. 
This error is caused by attempting to search 
for a feature model when the hSearchinglmage 
property is not set. 



32003 HRESULTPOINT_NOT__DEFINED 

A result point must be defined. 
This error is caused by attempting to search 
15 for a feature model when the hResultPoint 

property is not set. 

hResultP oint Property, Search Tool Control 

Description 

Sets or returns the Point in which to return 
20 the location of the feature model as found by the last 
Search method. This property is not available at design 
time . 



Visual Basic 

[form.] SearchTool . hResultPoint (= hCtlf] 

25 Visual C++ 

pSearchTool-*Ge tNumProperty ( "hResultPoint " ) 
pSearchTool-*SetNumProperty ( "hResultPoint " , 
hCtl) ; 

Remarks 

30 This property should be set before searching 

for a feature model . It should be set to the hCtl 
property of a Point control which is on the hSearchingl- 
mage. When the Search method is called, the Point will 
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be set to the location at which the feature model was 
found. If MaximumNumberOfResults is more than one, set 
the hResultPoint property to an array of Points. The 
array should have at least MaximumNumberOfResults 
5 entries. The location result may also be accessed 
through the ResultX and ResultY properties. 

Data Type 
Long 

hTraininglmage, hSearchinaTm a ae Property. Saarrh -rv.nl 

xu control . — 

Descrip tion 

Sets or returns the Editable Images to be used 
by Train and Search. 



15 



25 



Visual Basic 

[form. ] SearchTool . hTraininglmage [= hCtl&] 
[form. ] SearchTool . hSearchinglmage [=hCtl&] 



Visual C+ + 

pSearchTool-*Ge tNumProperty ( » hTraininglmage " ) ; 

pSearchTool-»SetNumPropert y ( « hTraininglmage " , 
zv hctl) ; 

pSearchTool-*Ge tNumProperty ( "hSearchinglmage" ) ; 

pSearchTool-*SetNumProperty{ "hSearchinglmage " , 

hctl) ; 



Remarks 

These properties must be set before training 
a feature model or searching for a feature model. They 
should be set to the hctl property of an Editable Image 
control. it is possible to making the training and 
searching image the same by setting hTraininglmage and 



l 



WO 97/17639 PCT/US96/1 6999 

-32- 

hSearchinglmage to the same hCtl of the same Editable 
Image. Both the training image and the searching images 
should normally have a region of interest defined by 
setting the hRegionOf InterestShape property of Editable 
5 Image . 

Data Type 
Long . 

Blobs Tool Control 

Description 

10 Referring now to Figures 23-27, the Blobs Tool 

control (at area 231) is a vision tool which computes 
various geometric, topological and other properties of 
objects within an editable image 230. The image is 
segmented into groups of connected pixels (blobs) , and 

15 then properties such as area, perimeter, and orientation 
are computed and can be individually retrieved. 

Various properties and methods allow the Blobs 
finding process to be controlled. These properties and 
methods can be accessed at design time and also at run 

20 time through a context sensitive popup menu 232. This 
menu can be accessed by clicking with the right mouse 
button on the Blobs Tool control . 

File Name 

VISION. VBX 



25 



Object Type 

Blobs Tool 
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Remarks 

The Blobs Tool has both a graphical user 
interface and a code interface. To use the Blobs Tool, 
do the following: 

1) The control must first be linked to an 
Image by setting the hlmage property. 
The image should have its 
hRegionOf InterestShape property set. 

2) Position an editable shape (i.e. 235 in 
Figure 23) to define the region in which 
blobs are to be found. 

3) Find the blobs (as illustrated in Figure 
24 at area 240) by either selecting Try 
from the popup menu, or by calling the 

15 Find method. 

4) The Blobs results may now be accessed 
through the relevant properties. 

The screen of Figure 25 is called from the 
menu 232 and is used to set/view the blob analysis 
20 parameters. The screen of Figures 26 and 27 are also 
called from the menu 232 and is used to set/view blob 
analysis thresholds. The screen of Figure 27 is also 
called from the menu 232 and is used to set/view the 
blob analysis parameters. 

25 Blobs To ol Ryampl ~ 

Place an Editable Image control onto a form, 
place an Editable Shape control on the image, place a 
Blobs Tool onto the form, and then past the following 
code into the declarations section of your form: 
3 0 Sub Form_Load() 

BlobsTooll . hImage=EditableImagel 
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Editablelmagel.hRegionOf InterestShape 
=EditableShapel 
End Sub 

Error M essages, Blobs Tool Control 

The following table lists the trappable errors 

for the Blobs Tool control. 

Error number Message explanation 

3 2 0 0 1 HIMAGE_NOTJDEFINED 

This error is caused by attempting 
to find blobs when the hlmage prop- 
erty is not set. 

Point Control 

Descrip tion 

Referring now to Figures 28 and 29, point, as 
represented by icon 280, is a Visual Basic custom 
control that provides a Geometric Point entity which can 
be interactively edited by its user at both design and 
run-time as illustrated by point editing options 282. 
Coordinates of the point in pixels is illustrated at 
area 283. 

File Name 

VISION. VBX 

Object Typ e 
Point 

25 Remark^ 

Points can be selected and moved interactively 
at run-time using the mouse as illustrated in Figure 29. 
The coordinates are updated as the point icon is moved. 
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Point position can be finely tuned (i.e. 
tunable option) by: 

Using a special toolbar that moves a Point by 
one pixel in the required direction. 

Pressing Cursor Keys on the keyboard when the 
Point is selected. 

Pressing the Left Mouse Button when the mouse 
is in a Nudge Zone. These are areas around the point 
which cause the cursor to change shape. Pressing the 
Left mouse button when the cursor is one of these Nudge 
Cursors will cause the Point to move one Pixel in the 
relevant direction. 

The application programmer can prevent the end 
user from moving, selecting, or fine tuning Points by 
15 setting the relevant property to False. 

Point Control Rvampl e Code 

The following example is a simple application 
that demonstrates the Point custom control . It consists 
of a minimal User Interface that sets the properties of 
20 a point at runtime. It also demonstrates property 
retrieval and custom events by writing some text on the 
screen that indicates the position of the point after it 
has been moved. 

To use the example, take the following steps: 
25 x - Make sure that the file VISION. VBX has 

been added to the project. 

2. Create the User Interface: 

Place CheckBox controls on the default 
Visual Basic Form. The names of the four CheckBox 
3 0 controls should remain at default (i.e. Checkl, Check2, 
Check3 and Check4 ) . 
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Optional: set the CheckBox controls' 
Caption properties as follows: 
CheckBox Caption 
Checkl Enabled 
5 Check2 Movable 

Check3 Tunable 
Check4 Visible 
Place a Label control on the form. The 
control's Name should be Labell. 
10 Place a Point custom control on the form. The 

control's Name should be Point 1. 
3 . Add the code . 

Paste the following code in the Declarations 
section of the form: 
15 Sub Checkl_Click() 

If Checkl. Value = 0 Then 

Pointl .Enabled = False 

Else 

Pointl. Enabled = True 
20 End If 

End Sub 

Sub Check2_Click () 

If Check2_Click() 

Pointl. Movable = False 

25 Else 

Pointl. Movable = True 
End If 
End Sub 

Sub Check3__Click() 
30 If Check3. Value = 0 Then 

Pointl .Tunable = False 

Else 

Pointl .Tunable = True 
End If 
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End Sub 

Sub Check4_Click () 

If Check4. Value = 0 Then 

Point 1. Visible = False 

5 Else 

Point 1 .Visible = True 
End If 
End Sub 

Sub Pointl_Move () 

10 labell. Caption = "x=" fc.Pointl.X & " y=" 

& Pointl.Y 

End Sub 

Add the following code in the default form's 
Load event: 

15 Initialize the Check boxes at start of program 

If Point l.Enabled=True Then Checkl .Value =1 
If Point 1. Movable =True Then Check2 .Value =1 
If Pointl.Tunable=True Then Check3 . Value=l 
If Point l.Visible=True Then Check4 . Value=l 

20 4. Press F5 to run the example. 

Editable Shape Control 

Descrip tion 

Referring now to Figures 30 and 31, Editable- 
Shape is a Visual Basic custom control which provides 
2 5 two dimensional geometric shapes that can be interac- 
tively edited. Within an area 300 are located interac- 
tive sizing handles 302. 
File Name 

VISION. VBX 
30 Object Type 

EditableShape 
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Remarks 

This custom control is like the Visual Basic 
Shape control but can be edited both at design time and 
by the end user at run- time. Furthermore, the user is 
able to interrogate the attributes of a shape such as 
its width, height, rotation etc. as illustrated at area 
304 . 

Like the Visual Basic custom control: Shape, 
EditableShape can take the form of an ellipse, rectan- 
gle, circle, or square as illustrated at area 306. At 
Runtime it can be selected, rotated, moved, resized and 
"mutated" to another shape interactively by the use of 
a mouse as illustrated by shape editing options 307. 

Like the Point custom control, the 
15 EditableShape can also be finely tuned using a similar 
toolbar. The centre button in the toolbar allows the 
user to change the fine-tune mode. By default, this is 
MOVEMODE (pressing the arrows will move the shape by one 
pixel in the relevant direction) . The mode can also be 
2 0 ENLARGEMENT or SHRINKMODE. Pressing the arrows will 
cause the shape to be enlarged or shrunk by one pixel on 
the relevant corner of the shape's bounding rectangle. 

The application programmer can prevent the 
user from moving, resizing, changing shape, rotating, 
25 selecting or fine-tuning an EditableShape by setting the 
appropriate property to False. Figure 31 illustrates 
popup menus 310 for run time shape editing. 

Editable Shape Example Code 



30 



The example demonstrates features of an 

EditableShape custom control using a minimal user 
interface . 

To use the example take the following steps: 
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1. Add the file VISION. VBX to a new Visual 
Basic project. 

2. Create the User Interface: 

• Place eight CheckBox controls on the 
default Visual Basic form. By default, 
the name of these controls should be 
Checkl, Check 2,. . Checks. 

• Give the following Captions to the con- 
trols just created. 
Control Caption 

Checkl Show Direction Arrow 

Check2 Enabled 
Check3 Movable 
Check4 Mutatable 
15 Checks Resizable 

Check6 Rotatable 
Check7 Tunable 
Check8 Visible 

• Place four OptionButton controls and give 
20 them the Name Optionl . Answer yes when 

asked "Do you want to create a control 
array?". Give the controls the following 
captions : 

Control Caption 
25 Optionl (0) Rectangle 

Optionl { 1 ) Square 
Optionl (2) Oval 
Optionl (3) Circle 

• Place three labels on the form. The 
30 names of these Label controls should be 

Label 1, Label 2 and Label 3 . 

• Place an Editable Shape custom control on 
the form, this should be named 
EditableShapel . 
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3 . Add the code . 

• Paste the following code in the Declara- 
tions section of the form: 

Sub Checkl_Click () 

EditableShapel .Direct ionArrow=Checkl .Value 
End Sub 

Sub Check2_Click () 

EditableShapel. Enabled = Check2. Value 
Upda t e Che ckBoxe s 
End Sub 

Sub Check3_Click () 

EditableShapel. Movable = Check3 .Value 
Upda t e Che c kBoxe s 
End Sub 

Sub Check4_Click () 

EditableShapel. Mutatable = Check4 . Value 
Upda t e Che c kBoxe s 
End Sub 

Sub Check4_Click () 

EditableShapel. Mutatable = Check4. Value 
Upda t e Che ckBoxe s 
End Sub 

Sub Check5_Click () 

EditableShapel. Resizable = Checks. Value 
Upda t eChe c kBoxe s 
End Sub 

Sub Check6_Click () 

EditableShapel .Rotatable = Check6. Value 

UpdateCheckBoxes 

End Sub 

Sub Check7_Click () 

EditableShapel. Tunable = Check7. Value 
UpdateCheckBoxes 
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End Sub 

Sub Check8_Click () 

EditableShapel. Visible = Checks. Value 
End Sub 

Sub EditableShapel_Move () 

Label 1 . Cap t ion = "CentreX=» & 
EditableShapel. ShapeWidth & » ShapeH=" & 
EditableShapel . ShapeHeight 
Sub EditableShapel_Resize () 

Label2. Caption - " S h a p e W = « & 
EditableShapel . ShapeWidth & « ShapeH+ " & 
EditableShapel . ShapeHeight 
End Sub 

Sub EditableShapel_Rotate () 

Label 3 . Capt ion = "Angle =» & 
EditableShapel . Roll 
End Sub 



Sub UpdateCheckBoxes {) 

Checkl. Value 
20 (EditableShapel . DirectionArrow) 

Check2. Value = Abs (EditableShapel . Enabled) 
Check3. Value = Abs (EditableShapel .Movable) 
Check4. Value = Abs (EditableShapel .Mutatable) 
Checks. Value = Abs (EditableShapel . Resizable) 
25 Check6. Value = Abs (EditableShapel . Rot a table) 

Check7. Value = Abs (EditableShapel .Tunable) 
Check8. Value = Abs (EditableShapel .Visible) 
End Sub 

• Add the following code in the default 
30 form's Load event: 

UpdateCheckBoxes 
Opt ionl (EditableShapel .Shape. Value = True 

• Add the following code to Option l's 
Click event: 
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EditableShapel .Shape = Index 
4. Press F5 to run the example. 
Stage Control 

Descrip tion 

Referring now to Figure 32, the Stage control 
provides facilities to control multi-axis stage hard- 
ware. The Stage control can control stage hardware 
which moves in X, Y, and Z axes, and which rotates 
around each axis (roll, pitch and yaw). The stage can 
be moved to an arbitrary (X, Y, Z , roll , pitch, yaw) posi- 
tion, moved to a home position, and moved to a number of 
stored positions. 

Various properties and methods allow the stage 
to be controlled. These properties and methods can be 
15 accessed at design time through a code interface and 
also at run time through an interactive graphical user 
interface at area 320. 

The Graphical User Interface 320 provided to 
control the stage manually provides facilities to move 
20 the stage in X,Y and Z axes and to change the roll of 
the stage. The point in the X/Y plane corresponding to 
the roll axis of rotation can also be moved. A Home 
operation is also provided by home button 321. 

File Name 
25 VISION. VBX 



Object Type 
Stage 
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Remarks 

Before the Stage control can be used, the 
control must first be linked to some particular type of 
stage hardware and at least one Editable Shape by 
setting the Stage and hStageShape properties. 

To use the graphical interface 320, adjust the 
X (322), Y (323), 2 (324), roll (325) , Pitch and yaw 
scrollbars, or enter position values explicitly in the 
text boxes. Methods and properties can be accessed 
through a context sensitive popup menu. This menu can 
be accessed by clicking with the right mouse button on 
the stage control. 



Error Messages, Stage Control 



15 



20 



25 



30 



35 



Error number 
32001 



32002 



The following table lists the trappable errors 
for the Stage control. 

Message explanation 

HIT_HARD_LIMIT 
Stage hit hard limit. 
This error is caused by 
attempting to move the 
stage beyond one of its 
hard limits. 

OUT_OF__BOUNDS 
Attempt to move stage out 
of bounds. 

This error is cause by 
attempting to move the 
stage outside its bounds, 
as specified by the 
hBoundsShape property. 

STILL_MOVING 

Attempt to move stage 
while still moving. This 
error is caused by 
attempting to move the 
stage while it is still 
moving . 



32003 
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32004 

5 

32005 

10 
15 

32006 

20 



STAGE_NOT_DE F I NED 
Attempt to move stage 
will still moving. 
This error is caused by 
trying to access the 
physical stage when the 
Stage property is not 
set . 

CAL I BRAT 1 0N_NOT_DE F I NED 
A calibration must be 
defined. 

This error is caused by 
trying to access the 
physical stage when the 
hCalibration property is 
not set . 

STAGE_SHAPE_NOTJDEF INED 
A physical stage shape 
must be defined. 
This error is caused by 
trying to access the 
physical stage when the 
hStageShape property is 
not set . 



25 Stage Control F yampU 

Place a Stage control onto a Form, place two 
Editable Shape controls onto the Stage control 326 (to 
define stage shape and bounds) , and then paste the 
following code into the declarations section of the 
3 0 form: 

Sub Form_Load {) 
Stagel. Stage = XYYStagel . hCtl 
Stagel. hStageShape = Editable Shapel.hCtl 
Stagel. hBoundsShape = EditableShape2 .hCtl 
35 a % = Stagel. Home 

End Sub 

Sub Form_Click () 
Stagel . DestinationX = 20 
Stagel. DestinationY = 30 
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Stagel .Destination Roll =45 

Stagel.Move 

End Sub 

Stage Pro perty, Stage Control 

5 Description 

Sets or returns the particular type of stage 
hardware. This property is not available at design 
time . 

Visual Baaif! 
10 [form. ] Stage. Stage [= stage&] 

Visual C++ 

p£tage-»GetNumProperty ( "Stage" ) 
pStage-»SetNumProperty { "Stage" , 
pXYZCompanyS t age ) 

15 Remarks 

This property may be set to the Stage property 
of an XYZCompanyStage Control, or from another source 
which provides a compatible property. 

Data Type 
2 0 Long . 

hStageShape Property, Stage Control 



Description 

Sets or returns the shape of the stage . 
property is not available at design time. 



This 



WO 97/17639 



PCI7US96/16999 



-46- 

Visual Basic 

[form. ] Stage .hStageShape [= hCtl&] 

Visual C++ 

pStage -> GetNumProperty ("hStageShape") 
5 pStage -+ SetNumProperty ("hStageShape", hCtl) 

Remarks 

This property should be set to the hCtl 
property of an Editable Shape Control. The graphical 
properties of the Editable Shape such as BorderColor can 
10 be set, but do not set the Shape, size, position or Roll 
properties of the Editable Shape, as these will be 
modified automatically by the State Control. 

Data Type 
Long. 

15 Typel Stage Control 

Description 

Referring to Figure 33, the Typel Stage 
Control is a run- time invisible control which provide an 
implementation of the Stage property for use by the 

20 Stage Control. The Typel Stage Control does not direct- 
ly move the motors to move the table - this control 
provides properties, methods and events to enable the 
motors to be moved from top level application code, and 
yet allow the application to use the standard Stage 

25 Control. 

File Name 

VISION.VBX 
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Obiecfc Typ^ 

TypelStage 

Remarks 

To use the Typel Stage Control, set the Stage 
property of the Stage Control equal to the Stage proper- 
ty of the Typel Stage Control at run time. 

Tvpel St age EyamplA 

Place a Stage Control and an Typel Stage 
Control (i.e., icon 330) onto a Form (to define the 
hardware and software interface to the Typel stage) , 
place two Editable Shape controls onto the Stage con- 
trol, and then paste the following code into the decla- 
rations section of the form: 
Sub Form_Load () 
15 Stagel. Stage = TypelStage . hCtl 

Stagel.hStageShape = EditableShapel . hCtl 
Stage 1 . hBounds Shape = EditableShape2 . hCtl 
End Sub 

Stage Property, Typel Stage Control 

20 Descrip tion 

Returns a value which can be used for the 
Stage property of the Stage Control. This property is 
read-only at run time, not available at design time. 

Visual Basin 
25 [form.] TypelStage. Stage 

Visual C++ 

PTypelStage -> GetNumProperty ("Stage") 
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Remarks 

Set the Stage property of the Stage Control 
equal to this property at run time. 

Data Typ e 
5 Long . 

Type2 Sta ge Control 

Descrip tion 

The Type2 Stage Control is a run-time invisi- 
ble control which provide an implementation of the Stage 
10 property for use by the Stage Control. 

File Name 

VISION. VBX 

Object Typ e 

Type2Stage 

15 Remarks 

To use the Type2 Stage Control, set the Stage 
property of the Stage Control equal to the Stage proper- 
ty of the Type2 Stage Control at run time. 

Type2 Stage Example 

20 Place a Stage Control and an Type2 Stage 

Control onto a Form, place two Editable Shape controls 
onto the Stage control, and then paste the following 
code into the declarations section of the form: 
Sub Form_Load () 
25 Stagel . Stage=Type2Stagel . hCtl 

Stagel . hStageShape=EditableShapel . hCtl 
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Stagel . hBoundsShape=EditableShape2 . hCtl 
End Sub 

Stage Property, Type 2 Stage Control 

Description 

5 Returns a value which can be used for the 

Stage property of the Stage Control . This property is 
read-only at run time, not available at design time. 

Visual Basic 

I form.] Type2Stage. Stage 

10 Visual C++ 

pType2Stage -* GetNumProperty ("Stage") 

Remarks 

Set the Stage property of the Stage Control 
equal to this property at run time. 

15 Date Type 

Long, 

Type3 Stage Control 

Description 

The Type3 Stage Control is a run- time invisi- 
20 ble control which provide an implementation of the Stage 
property for use by the Stage Control . 

File Name 

VISION. VBX 
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Obiect Type 

Type3Stage . 

Remarks 

To use the Type3 Stage Control, set the Stage 
property of the Stage Control equal to the Stage proper- 
ty of the Type3 Stage Control at run time. 

Type3 Stage Example 

Place a Stage Control and a Type3 Stage 
Control onto a Form, place two Editable Shape controls 
onto the Stage control, and then paste the following 
code into the declarations section of the form: 
Sub ForrnJLoad () 
Stagel . Stage=Type3Stagel . hCtl 
Stagel . hStageShape=EditableShapel . hCtl 
Stagel . hBoundsShape=EditableShape2 . hCtl 
End Sub 

Stage Property, Type 3 Stage Control 

Description 

Returns a value which can be used for the 
Stage property of the Stage Control. This property is 
read-only at run time, not available at design time. 

Visual Basic 

[form.] Type3Stage. Stage 



10 



15 



25 



Visual C++ 

pType3S tage^Ge tNumProperty ( " Stage " ) 
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Remarks 

Set the Stage property of the Stage Control 
equal to this property at run time. 

Data Typ ^ 
5 Long . 

Toolbar Control 

Descrip tion 

The Toolbar control allows you to create a 
context-sensitive toolbar for navigating the windows and 
10 menus in the application using simple button clicks. It 
is generally used as a graphical replacement for the 
main menu bar of the application. Buttons for window 
selection, sub-window selection and popup menu selection 
can be added to the toolbar, as well as custom buttons 
15 for specific commands. Custom buttons may be volatile, 
i.e. appearing only in a specific context, or fixed, 
i.e. always visible. Some predefined fixed buttons are 
provided for common commands such as Help, Undo, Print, 
Save, Open, and Exit. The route taken through the menu 
levels to the current menu is shown at the tope of the 
toolbar, providing a visual reminder of the route and 
also allowing the user to instantly jump back to any 
level . 

File Name 
25 VISION. VBX 

Object Type 
Toolbar 



20 
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Remarks 

To add any type of button you must first set 
the Button Type property. 

To add window selection buttons to the 
toolbar, you must set the Windowlndex property, and then 
set the WindowhWnd property. This must be done at run- 
time. Buttons for sub-windows and popup menus may be 
similarly added. 

To add a popup menu to the toolbar you must 
set the Windowindex property, set the SubWindowIndex 
property, and then set the WindowhMenu property. The 
SubWindow must be previously defined. 

To add a custom fixed command button, set the 
Buttonlndex property to an unused button index, and set 
the ButtonPicture and ButtonCaption properties. This 
may be done only at run time. 

Predefined fixed command buttons such as the 
Help button may be enabled/disabled by setting the 
appropriate Visible property to True, eg. 
HelpButtonVisible . 

To add a custom volatile command button, use 
the Windowlndex and SubWindowIndex properties to navi- 
gate to the desired context, set the Buttonlndex proper- 
ty to an unused button index, and set the ButtonPicture 
and ButtonCaption properties. This may be done only at 
run time. 

Default captions are generated for each button 
but may be overridden. For example, to change the 
default caption for a window selection button, set the 
ButtonType property, set the Windowlndex property to the 
desired window, and then set the ButtonCaption property. 
This may be done only at run time. 
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ButtonTvpe Proper ty , Toolbar Control 

Descriptip n 

Sets the type of the buttons. 

Visual Basin 

5 [form.) Toolbar. But tonType [= {Fixed | Volatile | 

Popup | Window}] 

Visual C++ 

pToolbar-*SetNumProperty(" But tonType" , { Fixed | 
Volatile | Popup (Window} ) 

10 Remarks 

Fixed buttons are always visible at the right 
hand end of the toolbar. Volatile buttons are attached 
to a particular window or sub window, visible only when 
the buttons for that particular window are visible. All 

15 Volatile buttons defined for one menu are kept in all 
the submenus . 

Data Type 

Integer 

Windowlndex. SubWindowIndex Properties, Toolbar Control 

20 Description 

Sets or returns the currently selected window 
or sub- window. 

Visual Basic 

[form.] Toolbar, But tonType [= {Window}] 
25 [form.] Toolbar. Windowlndex [=index%] 

[form. ] Toolbar. SubWindowIndex] 



I 



WO 97/17639 



PCT/US96/16999 



-54- 

Visuai C++ 

pTooI&ar-^SetNumProperty ( "ButtonType" , {WINDOW} ) 
pToolbar-^SetNumProperty ( "Windowlndex" ) , index) 
pToolbar-*SetNumProperty ( "SubWindowIndex" , 
5 index) 

Remarks 

The window index and sub-window index can be 
used to both set and get the currently selected windows. 
The indexes are numbered from zero, -1 means no current 
10 selection. It is necessary to set the indexes in order 
to add new windows and menus to the structure of the 
toolbar, and also to override default button captions. 

Data Type 

Integer. 

15 WindowhMenu Property, Toolbar Control 

Description 

Sets or returns the hMenu of the popup menu of 
the currently selected window or sub-window. Not 
available at design time. 

20 Visual Basic 

[form. ] Toolbar. ButtonType [= {Window}] 
[form. ] Toolbar. Windowlndex Oindex%] 
[form. ] Toolbar . SubWindowIndex [=index%] 
[form. ] Toolbar. WindowhMenu [=handle%] 

25 Visual C++ 

pToolbar-*Se tNumProperty ( "ButtonType" , {WINDOW} ) 
pToolbar-*Se tNumProperty ( "Windowlndex" , index) 
pTooIbar-*SetNumProperty ( "SubWindowIndex" , 
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Index) 

pToolbar-*Ge tNumProperty ( " WindowhMenu " ) 
pTooljbar-^SetNumProperty ( "WindowhMenu" , handle) 

Remarks 

5 When a popup menu is added to the toolbar, a 

button is added for each menu option and each submenu 
option. By default, the caption is taken from the menu 
itself. 

To add a new popup menu set of buttons to the 
10 toolbar, set the ButtonType property, set the 
Windowlndex property to the appropriate window index 
number, set SubWindowIndex to the appropriate window 
index number, and then set the WindowhMenu property to 
the HMENU of the popup menu. 

15 Data Type 

Integer. 



Buttonlndex Property , Toolbar Control 



Description 

Sets or returns the current volatile/fixed/ 
20 popup button index. 

Visual Basic 

t form . ] Toolbar . But tonType [ = { Fixed | Vol at i le | 
Popup | Window} ] 

[form. ] Toolbox. Buttonlndex [=index%] 



25 Visual C++ 

pToolbar-+Se tNumProperty ("ButtonType" , {FIXED| 
VOLATILE | POPUP | WINDOW} ) 

pToolJbar-»SetNumProperty ( "Buttonlndex" , Index) 



I 



WO 97/17639 



PCT/US96/16999 



-56- 

Remarks 

The button index must be set in order to 
override default button captions. Button indexes for 
volatile or fixed buttons are numbered from zero on- 
5 wards . 

To change the default caption for a menu item, 
set the Button Type property, set the Buttonlndex 
property to the index of the desired button, then set 
the ButtonCaption and/or ButtonPicture properties. 

10 Data Type 

Integer . 

ButtonPicture Property, Toolbar Control 

Description 

Specifies a bitmap to display on a 
15 button/window. 

Visual Basic 

[form. ] TooIJbar.ButtonType [ = {Fixed | Volatile | 
Popup}] 

[form. ] Toolbar. ButtonIndex=index% 
20 [form. ] Toolbar, ButtonPicture [-picture] 

[form.] Toolbar. But tonType [-{Window}] 
[form. ] Toolbar. WindowIndex=index% 
[form. ] Toolbar. SubWindowIndex=index% 
[form. ] Toolbar. ButtonPicture [=picture] 

25 Visual C++ 

pToolJbar-*SetNumProperty ( "But tonType " , {FIXED | 
VOLATILE | POPUP}) 

pToolJbar-^SetNumProperty { "Buttonlndex" , index) 
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pToolbar-^GetNumProperty ( "ButtonPicture" ) 
pToolbar-^SetNumProperty ( "ButtonPicture " , 
picture) 



5 



pToolbar-*SetNumProperty ( "But tonType" , {WINDOW} ) 
pToolbar-^SetNumProperty ( "Windowlndex" , index) 



pToolbar-*Se tNumProperty ( "SubWindowIndex" , 
index) 
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pToolbar^Ge tNumProperty { "ButtonPicture " ) 
pToolbar~*Se tNumProperty ( "ButtonPicture " , 
picture) 



Data Type 

Integer. 

ButtonCaption Property, Toolbar Control 

Description 

15 Specifies a caption to display on a button. 

Visual Basic 

[form. ] Toolbar. But tonType O {Fixed] Popup | 
Window} ] 

[form. ] Toolbar. ButtonIndex=index% 
2 0 [form.] Toolbar. Butt onCapt ion [ = cap tion$] 



Visual C++ 
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pToolbar->SetNumProperty { "But tonType" , { FIXED | 
VOLATILE | POPUP | WINDOW} ) 

pToo!bar-*SetNumProperty ( "Buttonlndex" , index) 
pTooIbar-*GetNumProperty ( "ButtonCaption " ) 
pToolbar-*SetNumProperty ( "ButtonCaption" , 
caption) 
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Remarks 

The popup menu button captions default to the 
captions that appear in the popup menu. Use the 
ButtonCaption property to override this caption. 

Data Typ e 

Integer. 



ExitButtonVisible HelpButtonVl«i b le. OkButtonViflible. 
CancelButtonVisible - P^intButtonVieible . SaveButton 
Visible f OpenButtonVi S ibl fl f UndoBut tonVi alble . 
10 NaxtButtonVisibleTP reviouflBnttonVifllbl* Pm r ^T^ 
Toolbar Control t£ L 

Description 

Determines if a predefined fixed button is 
visible or invisible at run time. 



I 5 Visual Basic 

[form. ] Toolbar. HelpButtonVisible [ = 
{True | False}] 

[form.] Toolbar. UndoButtonVisible [ = 
{True | False}] 

20 [form. ] Toolbar. PrintButtonVisible [ = 

{True | False}] 

[form. ] Toolbar. OpenButtonVisible [ = 
{True | False}] 

[form.] Toolbar. SaveButtonVisible [ = 
25 {True|False}] 

[form. ] Toolbar. ExitButtonVisible [- 
{True | False}] 

[form.] Toolbar. OkButtonVisible [= 
{True | False}] 

30 [form. ] Toolbar. CancelButtonVisible [ = 

{True | False}] 

[form. ] Toolbar. NextButtonVisible [ = 
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{True|False}] 

[form.] Toolbar. PreviousButtonVisible [ = 
{True (False}] 

Visual C++ 

5 pToolbar-*GetNumProperty ( "HelpButtonVisible" ) 

pTooibar-*SetNumProperty ( "HelpButtonVisible" , 
{TRUE | FALSE}) 

pToolbar-+Ge tNumProperty { "UndoButtonVisible" ) 
pToo!bar->SetNumProperty ( "UndoButtonVisible" , 
10 {TRUE | FALSE}) 

pToolbar-*Ge tNumProperty ( "PrintButtonVisible" ) 
pToo!bar-*SetNumProperty { "PrintButtonVisible" , 
{TRUE | FALSE}) 

pToo!bar-*GetNumProperty ( "OpenButtonVisible" ) 
15 pToolbar-*SetNumProperty ( "OpenButtonVisible" , 

{TRUE | FALSE}) 

pToo!bar-*GetNumProperty { "SaveButtonVisible" ) 
pToolbar-+Se tNumProperty ( "SaveButtonVisible" , 
{TRUE | FALSE}) 

20 pToolbar->GetNumProperty ( " ExitButtonVisible" ) 

pToolbar->SetNumProperty (" Exit But tonVisible" , 
{TRUE | FALSE}) 

pToolbar-^GetNumProperty ( "OkButtonVisible" ) 
pToolbar-*SetNumProperty ( "OkButtonVisible" , 
25 {TRUE | FALSE}) 

pToolbar-^Ge tNumProperty ( "CancelButtonVisible" ) 
pToolbar->SetNumProperty ( "CancelButtonVisible" , 
{TRUE | FALSE}) 

pToolbar-^GetNumProperty ( "NextButtonVisible" ) 
30 pToolbar-*SetNumProperty ( "NextButtonVisible" , 

{TRUE | FALSE}) 

pToo!bar->GetNumProperty ( "PreviousButton 
Visible") 
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pTooibar-»SetNumProperty ( " PreviousButton 
Visible" , {TRUE | FALSE}) 



Remarks 

The predefined fixed buttons appear in the 
5 right hand end fixed section of the toolbar. They have 
predefined captions, and generate predefined events, 
such as Help Click. 



Data Type 

Integer (Boolean) . 



10 Windowlndex, SubWindowIndex Properties, Toolbar Control 

Description 

Sets or returns the currently selected window 
or sub -window. 



Visual Basic 

15 [form. ] Toolbar. But tonType [= {window}] 

[form. ] Toolbar. Windowlndex [=index%] 
[form. ] Toolbar. SubWindowIndex [=index%] 

Visual C++ 

pToo!bar->SetNumProperty ( "But tonType" , {WINDOW} ) 
20 pToolbar-»SetNumProperty { "Windowlndex" , index) 

pToolbar->SetNumProperty ( "SubWindowIndex" , 
index) 



Remarks 

The window index and sub-window index can be 
25 used to both set and get the currently selected windows. 
The indexes are numbered from zero, -1 means no current 
selection. It is necessary to set the indexes in order 
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to add new windows and menus to the structure of the 
toolbar, and also to override default button captions. 

Data Type 

Integer. 

5 While the best mode for carrying out the 

invention has been described in detail, those familiar 
with the art to which this invention relates will 
recognize various alternative designs and embodiments 
for practicing the invention as defined by the following 
10 claims. 
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What Is Claimed Tsr 

1. A method for quickly developing applica- 
tion software for use in a machine vision system using 
a computer system, the method comprising the steps of: 
storing an application development program, 
including a first set of custom control programs repre- 
senting possible components of a user interface for the 
machine vision system, the first set of custom control 
programs defining a first set of custom controls; 

storing a second set of custom control pro- 
grams representing possible machine vision algorithms 
for the machine vision system, the second set of custom 
control programs defining a second set of custom con- 
trols ; 

15 storing hardware operating parameters corre- 

sponding to possible hardware for use in the machine 
vision system, the hardware operating parameters defin- 
ing a third set of custom controls; 

displaying a graphical representation of the 
20 possible components, the possible hardware and the 
possible machine vision algorithms ; 

receiving commands from a user of the computer 
system to select a first custom control program corre- 
sponding to a desired component of the user interface 
desired hardware operating parameters corresponding to 
desired hardware and a second custom control program 
corresponding to a desired machine vision algorithm; and 
linking the first custom control program with 
the desired hardware operating parameters to the second 
custom control program to form the application software 
in response to the commands. 
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2. The method as claimed in claim 1 wherein 
the custom controls include properties and wherein the 
step of linking includes the step of setting the proper- 
ties of the custom controls. 

3 . The method as claimed in claim 2 wherein 
the step of setting includes the step of setting one 
property of one custom control to be equal to one 
property of another custom control . 

4 . The method as claimed in claim 1 wherein 
the step of linking includes the step of receiving a set 
of instructions from the user of the computer system. 

5. The method as claimed in claim 1 further 
comprising the steps of: 

storing a third set of custom control programs 
representing possible software products for use in a 
machine vision system; and 

displaying a graphical representation of the 
possible software products, wherein the step of linking 
links a third custom control program corresponding to a 
desired software product with the first and second 
custom control programs and the desired hardware operat- 
ing parameters in response to the commands to form the 
application software. 

6 . The method as claimed in claim 1 wherein 
the desired hardware operating parameters correspond to 
a desired image source of the machine vision system. 

7. The method as claimed in claim 6 wherein 
the desired image source is a video camera. 
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8. The method as claimed in claim 6 wherein 
the desired operating parameters further correspond to 
a desired vision processor board of the machine vision 
system. 



9. The method as claimed in claim 6 wherein 
the desired hardware operating parameters further 
correspond to a desired frame grabber board of the 
machine vision system. 



10. The method as claimed in claim 6 wherein 
the desired hardware operating parameters further 
correspond to a desired motion board of the machine 
vision system. 

11. The method as claimed in claim 6 wherein 
the desired hardware operating parameters further 
correspond to a desired bus of the machine vision 
system. 

12. The method as claimed in claim 6 wherein 
the desired machine vision algorithm is an image pro- 
cessing algorithm. 



13 . The method as claimed in claim 6 wherein 
the desired machine vision algorithm is an image-analy- 
sis algorithm. 



25 



14. The method as claimed in claim 6 wherein 
the desired machine vision algorithm is a calibration 
space algorithm. 
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15. The method as claimed in claim 6 wherein 
the desired machine vision algorithm is an interactive 
CAD/geometry algorithm. 

16. The method as claimed in claim 6 wherein 
the computer system includes a personal computer. 

17. A computer system for quickly developing 
application software for use in a machine vision system, 
the system comprising: 

means for storing an application development 
program, including a first set of custom control pro- 
grams representing possible components of a user inter- 
face for the machine vision system, the first set of 
custom control programs defining a first set of custom 
controls; 

means for storing a second set of custom 
control programs representing possible machine vision 
algorithms for the machine vision system, the second set 
of custom control programs defining a second set of 
custom controls; 

means for storing hardware operating parame- 
ters corresponding to possible hardware for use in the 
machine vision system, the hardware operating parameters 
defining a third set of custom controls; 

means for displaying a graphical representa- 
tion of the possible components, the possible hardware 
and the possible machine vision algorithms; 

means for receiving commands from a user of 
the computer system to select a first custom control 
program corresponding to a desired component of the user 
interface, desired hardware operating parameters corre- 
sponding to desired hardware and a second custom control 
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program corresponding to a desired machine vision 
algorithm; and 

means for linking the first custom control 
program with the desired hardware operating parameters 
5 to the second custom control program to form the appli- 
cation software in response to the commands. 

18. The computer system as claimed in claim 

17 wherein the custom controls include properties and 
wherein the means for linking includes means for setting 

10 the properties of the custom controls. 

19. The computer system as claimed in claim 

18 wherein the step of setting includes the step of 
setting one property of one custom control to be equal 
to one property of another custom control. 



15 



20. The computer system as claimed in claim 
17 wherein the step of linking includes the step of 
receiving a set of instructions from the user of the 
computer system. 



21. The computer system as claimed in claim 
17 further comprising: 

means for storing a third set of custom 
control programs representing possible software products 
for use in a machine vision system; and 

means for displaying a graphical representa- 
tion of the possible software products, wherein the step 
of linking links a third custom control program corre- 
sponding to a desired software product with the first 
and second custom control programs and the desired 
hardware operating parameters in response to the com- 
mands to form the application software. 
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22. The computer system as claimed in claim 
17 wherein the desired hardware operating parameters 
correspond to a desired image source of the machine 
vision system. 

5 23. The computer system as claimed in claim 

22 wherein the desired image source is a video camera. 

24 . The computer system as claimed in claim 
22 wherein the desired operating parameters further 
correspond to a desired vision processor board of the 

10 machine vision system. 

25. The computer system as claimed in claim 
2 2 wherein the desired hardware operating parameters 
further correspond to a desired frame grabber board of 
the machine vision system. 

15 26. The computer system as claimed in claim 

22 wherein the desired hardware operating parameters 
further correspond to a desired motion board of the 
machine vision system. 

27. The computer system as claimed in claim 
20 22 wherein the desired hardware operating parameters 

further correspond to a desired bus of the machine 
vision system. 

28 . The computer system as claimed in claim 
22 wherein the desired machine vision algorithm is an 

25 image processing algorithm. 
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29. The computer system as claimed in claim 
22 wherein the desired machine vision algorithm is an 
image -ana lysis algorithm. 



30. The computer system as claimed in claim 
22 wherein the desired machine vision algorithm is a 
calibration space algorithm. 

31. The computer system as claimed in claim 
22 wherein the desired machine vision algorithm is an 
interactive CAD/geometry algorithm. 

32. The computer system as claimed in claim 
22 wherein the computer system includes a personal 
computer . 
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